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(54) Communication of VBI data in digital television data streams 



(57) ' A method and apparatus are provided for com- 
municating VBI user information in digital television data 
streams via a generic syntax. The syntax allows the dig- 
ital transport of virtually any type of user data that may 
be carried in the VBI portion of an analog television sig- 
nal. A pixel generator is used to insert VBI lines into a 
digital video signal using information provided in the 



user portion of the digital data stream. The syntax pro- 
vides the pixel generator with the start time of the first 
symbol, the number of pixels per symbol, the high and 
low levels to insert, the fraction of the symbol time that 
is transition time, the number of symbols to insert and 
the frame line number on which to insert the data. 
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Description 

BACKGROUND OF THE INVENTION 

s The present invention relates to the communication of digital television signals, and more particularly to a band- 
width efficient scheme for enabling a digital television data stream to carry most types of data conventionally carried in 
the vertical blanking interval (VBI) of an analog television signal. Examples of such data, hereinafter referred to as "user 
data", include closed caption data (CC) ( vertical interval time code (VITC), non-realtime video data (e.g., vertical inter- 
val test signal • VITS), sampled video data, North American Basic Teletext Specification (NABTS), World System Tele- 

10 text (WST), European Broadcast Union (EBU) data and Nielsen Automated, Measurement, and Lineup (AMOL) data. 
Digital transmission of television signals can deliver video and audio services of much higher quality than analog 
techniques. Digital transmission schemes are particularly advantageous for signals that are broadcast via a cable tele- 
vision network or by satellite to cable television affiliates and/or directly to home satellite television receivers. It is 
expected that digital television transmitter and receiver systems will replace existing analog systems just as digital com- 

15 pact discs have replaced analog phonograph records in the audio industry. 

One way to transmit the compressed video data to a receiver is in the form of packets contained within a packetized 
data stream. Typically, packets carrying compressed video data are multiplexed with other packets, e.g., carrying cor- 
responding audio data and control information necessary to reconstruct a television signal. One standard for transport- 
ing digital television signals in this manner is the MPEG-2 standard, details of which can be found in the International 

20 Organisation for Standardisation, ISO/IEC 13818-1 , International Standard, 13 November 1994 entitled "Generic Cod- 
ing of Moving Pictures and Associated Audio: Systems," recommendation H.222.0, incorporated herein by reference. 
Further details of the video syntax and semantics for MPEG-2 video can be found in International Organisation for 
Standardisation, ISO/IEC 13818-2, International Standard, 1995 entitled "Generic Coding of Moving Pictures and Asso- 
ciated Audio: Video," recommendation H.262, also incorporated herein by reference. 

25 Another standard for transporting digital television data in a packet stream is the Advanced Television Systems 
Committee (ATSC) Digital Television Standard A/53, approved on April 12 and September 15, 1995, incorporated 
herein by reference. The ATSC Digital Television Standard is based on the ISO/IEC MPEG-2 Video Standard, the Dig- 
ital Audio Compression (AC-3) Standard, and the ISO/IEC MPEG-2 Systems Standard. 

In the ATSC and MPEG-2 systems (and the similar DigiCipher® II system proprietary to General Instrument Cor- 

30 poration, the assignee hereof) a transport stream, or transport multiplex is made up of a contiguous set of fixed length 
packets. The video sequence is transported using a hierarchical structure in which a sequence header is followed by 
various extensions, user data, a group of pictures ("GOP") header, optional user data, a picture header, etc. The 
sequence header provides information for a sequence of pictures, which in general will include more than one GOP. 
This information includes, for example, horizontal and vertical size values, aspect ratio, frame and bit rate, and quanti- 

35 zation parameters for the video data. A user data extension can also be included which, among other things, provides 
additional data for use by decoders. The DigiCipher® II standard provides for the transport of additional user data after 
the sequence header, in order to identify a DigiCipher® II signal and the use of any special video compression tech- 
niques used within a sequence, including DigiCipher® special prediction and block motion estimation. 

In both the MPEG-2 and DigiCipher® II syntaxes, a sequence display extension containing, e.g., video format and 

40 color description information, is provided in addition to the sequence extension and user data. A subsequent group of 
pictures header provides, among other information, a time code. Thereafter, a picture header is provided which includes 
various information pertaining to a corresponding picture in a sequence of pictures to be displayed. A picture extension 
and, ultimately, the actual picture data to be decoded and reproduced for viewing, is then provided. It is noted that 
MPEG does not specify the order in which various extensions (such as the sequence display extension) or the user data 

45 must be transmitted beyond the fact that they must be after the sequence extension and before the GOP header (if pro- 
vided) or the picture header. MPEG does not require GOP headers to be sent, and such headers may be bypassed in 
particular implementations. 

In a practical transmission system it may be necessary to include additional data at different times for specific pur- 
poses, such as providing closed captioning, VITS, auxiliary real time video, Teletext, and AMOL data. Such additional 
so data may be carried in the vertical blanking interval (VBI) portions of an analog television signal, and is referred to 
herein as "VBI user information", "user data", or "user information." 

Many standards have been developed for services provided via waveforms carried in the VBI lines of analog and 
composite video. Digital video compression systems tend to employ algorithms optimized for the characteristics of two 
dimensional motion video. These algorithms are not generally well suited for the compression of video waveforms 
55 present in the VBI lines of analog video. 

The character of VBI waveforms is very different compared to active video. Lack of compression for these lines is 
very bandwidth intensive, such as sending 8 or 10 bit samples of 704 or 720 luminance and chrominance pixels. For 
example, 720 luminance and chrominance values at 8 bit resolution and 30 Hz requires 345,600 bps while the informa- 
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tion conveyed by these lines only represents 480 bps for closed captions and 6720 bps for North American Basic Tele- 
text Specification. As the transition to digital video proceeds, the demand for carriage and reconstruction of VBI 
services continues. Digital video distribution systems are expected to reconstruct the VBI as well as the active video, 
even when digital video compression techniques are employed. Thus, there is a need for algorithms, syntax and 

5 semantics specifically for the compression of VBI video lines that will allow an efficient and flexible alternative to devel- 
oping VBI -waveform specific user data syntax and semantics. 

It would be advantageous to provide a generic transport syntax and semantics for digital television data that would 
accommodate various types of VBI user information which may or may not be used at any given time. Such a scheme 
would enable the economical management of bandwidth while providing flexibility as to the transport of VBI user infor- 

10 mation. The present invention provides a transport method and apparatus enjoying the aforementioned advantages. 

SUMMARY OF THE INVENTION 

In accordance with the present invention, a method is provided for communicating, in a digital television data 

is stream, user information of a type conventionally carried as non-return-to-zero (NRZ) data in a vertical blanking interval 
(VBI) waveform of an analog television signal. For purposes of this disclosure, the term "NRZ data" is meant to include 
other types of data that can be represented as NRZ data, such as Manchester encoded data. The digital television data 
stream transports data according to a convention that includes a user data syntax. Such conventions include, without 
limitation, the MPEG-2, ATSC and DigiCipher II digital television standards In accordance with the method, the conven- 

20 tional user data syntax is supplemented with a line indicator value specifying one or more horizontal television lines rel- 
ative to a base VBI frame line in which user information is carried as NRZ data in a counterpart analog television signal. 
The user data syntax is also supplemented with at least one timing reference value that defines a relationship between 
a symbol rate of the NRZ data and a reference clock of the digital television data stream. The user data syntax is further 
supplemented with at least one count value indicating an amount of user information carried in the digital television data 

25 stream. The user data syntax is then supplemented with at least one user information field sufficient to carry the amount 
of user information indicated by the at least one count value. 

The user data syntax can be further supplemented with a start sample value. The start sample value is indicative 
of a sample point at which a transition into a first luminance (luma) NRZ symbol is to commence in a counterpart tele- 
vision signal reconstructed from the digital television data stream. 

30 The user data syntax can be further supplemented with a first amplitude value indicative of an amplitude at which 
luma NRZ symbols are to appear in the counterpart television signal that is reconstructed from the digital television data 
stream. 

The user data syntax can be further supplemented with a pulse shape value indicative of a pulse shape that is to 
be provided for the luma NRZ symbols in the counterpart television signal reconstructed from the digital television data 
35 stream. Moreover, the user data syntax can be supplemented with a field number indicative of a television field in which 
corresponding VBI data is to be inserted in the counterpart television signal reconstructed from the digital television 
data stream. 

Advantageously, the user data syntax is capable of delivering a plurality of luma NRZ constructs. Each construct 
carries associated user information. In such an embodiment, the user data syntax is supplemented with a luma NRZ 

40 count value indicative of the number of the luma NRZ constructs following the luma NRZ count value. The user data 
syntax can also be supplemented with a data type field specifying that luma NRZ data follows. 

The user data syntax can be supplemented with a second amplitude value indicative of a second amplitude level 
of the luma NRZ symbols. A priority value can be provided in the syntax to designate a priority of the luma NRZ con- 
structs for use in reconstructing the counterpart television signal from the digital television data stream. 

45 As indicated above, the user data syntax is supplemented with a timing reference value. This value can comprise 
a luma NRZ symbol clock increment value and a luma NRZ modulus value. The symbol clock increment and modulus 
values are related to the NRZ symbol rate and the reference clock as follows: 

increment value _ symbol rate 
so modulus value " reference clock 



The count value can comprise a word count indicating an integer number of luma NRZ words that follow and a 
remainder count indicating a number of luma NRZ bits totaling less than a full luma NRZ word that follow. The syntax 
55 thereby provides an efficient use of bandwidth by enabling remainders of less than a full NRZ word to be communi- 
cated. In a specific embodiment, such as an MPEG-2 or ATSC implementation, the luma NRZ words are each 22 bits 
in length, and the method comprises the further step of inserting a marker bit after each luma NRZ word to guard 
against a false MPEG start code. 
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The user information can be carried according to the user data syntax as luma NRZ words and luma NRZ bits. 
Each luma NRZ word comprises a string of luma NRZ symbols with the first bit corresponding to a first luma NRZ sym- 
bol to be reconstructed on a video line as displayed from left to right. Each luma NRZ bit represents a luma NRZ symbol 
to be reconstructed on the video line. The luma NRZ bits are provided in the order in which their symbols are to be 
5 reconstructed on the video line subsequent to symbols reconstructed from any luma NRZ words, as displayed from left 
to right. 

Receiver apparatus is provided for decoding, from a digital television data stream, user information of a type con- 
ventionally carried as NRZ data in a vertical blanking interval waveform of an analog television signal. The digital tele- 
vision data stream transports data according to a convention that includes a user data syntax. A syntax processor 

10 detects information carried in accordance with the user data syntax. Such information includes a first value identifying 
at least one horizontal television line relative to a base VBI frame line in which particular user information is carried in 
a counterpart television signal. A second value identifies a relationship between an NRZ symbol rate of the counterpart 
television signal and a digital television data reference clock A third value indicates an amount of user information car- 
ried in the digital television data stream. The information carried in accordance with the user data syntax also includes 

is the actual user information to be conveyed. A reconstruction processor is responsive to the first, second and third val- 
ues for formatting the user information into VBI N RZ data. A VBI inserter is provided for inserting the VBI NRZ data into, 
for example, a digital television signal from which an analog television signal can be reconstructed. Alternatively, such 
a digital television signal can be directly recorded or reproduced by a digital television appliance such as a video 
recorder or digital television. 

20 In the illustrated embodiment, the syntax processor detects a start sample value indicative of a sample point at 
which a transition into a first NRZ symbol is to commence in the reconstructed television signal. The VBI inserter is 
responsive to the start sample value for inserting the NRZ data into the reconstructed television signal. The syntax proc- 
essor detects a first amplitude value indicative of an amplitude at which NRZ symbols are to appear in the reconstructed 
television signal. The reconstruction processor is responsive to the first amplitude value to provide the VBI NRZ data at 

25 the amplitude indicated by the first amplitude value. 

The syntax processor of the illustrated embodiment detects a pulse shape value indicative of a pulse shape that is 
to be provided for the NRZ symbols in the reconstructed television signal. The reconstruction processor is responsive 
to the pulse shape value to provide the VBI NRZ data with the pulse shape indicated. 

The syntax processor can further detect a field number indicative of a television field in which corresponding VBI 

30 data is to be inserted in the reconstructed television signal. The VBI inserter is responsive to the field number for insert- 
ing the corresponding VBI data into a proper field. Moreover, the syntax processor can detect an NRZ count value indic- 
ative of a number of NRZ constructs to be processed. In response to the NRZ count value, the subsequent NRZ 
constructs will be processed. 

The syntax processor can further detect a data type field for locating NRZ data in the digital television data stream. 

35 Also, a data length field can be provided to enable unsupported data types to be ignored by skipping an amount of data 
specified by the data length field. 

A second amplitude value can be provided for detection by the syntax processor. The second amplitude value is 
indicative of a second amplitude at which NRZ symbols are to appear in the reconstructed television signal. The pur- 
pose of the first and second amplitude values is to control the luminance level for the "0" and n 1" symbols. In such an 

40 embodiment, the reconstruction processor is responsive to the first and second amplitude values to provide the VBI 
NRZ data at the first and second amplitudes. 

The syntax processor can also detect a priority value designating a priority of the NRZ constructs. The priority 
established by the priority value enables decoders having different capabilities to be accommodated, with individual 
decoders deciding which lines to reconstruct based on an assigned priority when they cannot reconstruct all lines sup- 

45 plied with the picture. The reconstruction processor is responsive to the priority value for reconstructing the selected 
lines. 

BRIEF DESCRIPTION OF THE DRAWINGS 

so Figure 1 is a block diagram of a digital video encoder that incorporates the present invention; 

Figure 2 is a block diagram of a video decompression processor incorporating the present invention; 

Figure 3 is a block diagram of a first embodiment of a pixel generator for generating a digital VBI waveform from 

user data carried in a digital video data stream in accordance with the present invention; 

Figure 4 is a block diagram of a second embodiment of a pixel generator for generating a digital VBI waveform from 
55 user data carried in a digital video data stream when the impulse response time of the VBI transmission standard 

is greater than one symbol time; and 

Figure 5 is a graph illustrating the frequency response of the interpolator of Figure 4. 
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DETAILED DESCRIPTION OF THE INVENTION 

The present invention provides a bandwidth efficient method and apparatus for using a digital television data 
stream to transport variable amounts of different types of information conventionally carried in the VBI portion of an ana- 

5 log television signal. The information of concern is a subset of a type of user data referred to as "picture user data" to 
distinguish it from "sequence user data" in an MPEG, ATSC or DigiCipher® II transport stream. This subset, referred to 
herein as VBI user information, comprises information such as closed caption data, sampled video data, NABTS, WST, 
EBU data and Nielsen AMOL data. Each of these categories of picture user data is updated each picture. The picture 
user data is transported in portions of successive video frames which correspond to VBI lines. Each VBI line is repre- 

10 sented by 720 eight-bit luminance samples and 720 eight-bit chrominance samples before processing in accordance 
with the present invention. 

The present invention resulted from a realization that most of the standard VBI waveforms can be represented as 
non-return-to-zero (NRZ) data modulated onto the luminance portion of a video signal. Such waveforms can be classi- 
fied by their pulse shape, number of pixels per symbol, symbol-to-risetime ratio, waveform start time within the video 

75 line, and applicable video system (i.e., video standard). Since none of the standards specify significant line-to-line or 
frame-to-frame correlation of data, each VBI line can be processed independently of any other VBI line. 

Moreover, the pulse shape specifications allow the different VBI waveforms to be categorized into waveforms that 
require a pulse shape of less than one symbol time in duration (such as non-Teletext waveforms) and waveforms that 
require a pulse shape of more than one symbol time (such as Teletext waveforms). 

20 The present invention capitalizes on the realizations set forth above with respect to the various different VBI wave- 
form formats to provide a syntax for the communication of VBI data in a digital television data stream. The invention fur- 
ther capitalizes on these realizations to provide a single state machine that is able to reconstruct most of the various 
VBI waveforms. The state machine allows the following parameters to he programmable: the field number of the partic- 
ular VBI line, the line number of the particular VBI line, the symbol rate used by the particular VBI waveform standard, 

25 the standard's CCIR-601 start sample number, the standard's risetime (symbol to transition duration ratio), the stand- 
ard's CCIR-601 value for NRZ "0" and "1" symbols, the number of symbols in the standard's waveform, and the vector 
of values of the symbols in the particular VBI line's waveform. As will be appreciated by those skilled in the art, "CCIR- 
601" is a standard promulgated by the International Radio Consultive Committee for digital component coding and fil- 
tering. 

30 Table 1 summarizes the key attributes of the known VBI waveform standards. The standards listed apply to either 
525-line (NTSC and PAL/M) or 625-line (PAL excepting PAL/M) video Systems. Each standard provides some portion 
of the waveform as a Timing Reference and Sync Pattern for the purpose of symbol synchronization. As well, each pro- 
vides a fixed number of Data Bits per video line, some of which may be provided for the purpose of Error Detection. 
Each modulates the data bits onto the video line via some Modulation technique and employing different Amplitudes to 

35 represent different data bit values. Finally, each waveform employs a nominal Symbol Rate (sometimes referenced to 
the video line rate [fh]) and Pulse (symbol) Shape (often specified with a rise time [tr] or Raised Cosine pulse shape 
with a particular value of Alpha). The unique attributes of particular standards are highlighted in bold font. 
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Table 1: Summary of VBI Waveform Standards. 
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Standard 


System 


Timing 
Reference 


Sync Pattern 


Data Bits 


Modulation 


Amplitude 


Symbol 
Rate 


Pulse Shape 




CC 


42* 


cycles 


3 bits 


16 


NRZ 


0 & 70 IRE 


32 fh 


tr=*240 nsec 


10 


AMOL 1 


hi 


sync bits 


7 bits 


41 


NRZ 


5 & 55 IRE 


1 Mbps 


tr=250 nsec 




AMOL U 


SIS 


Sync Bits 


8 bits 


88 


NRZ 


5 & 55 IRE 


2 Mbps 


tr— 125 nsec 




NABTS 


525 


sync bits 


16 bits 


272 


NRZ 


0 & 70 IRE 


364 ft 


alpha- 1.0 




WsY 


515 


sync bits 


24 bits 


272 


mi 


0 & 66 IRE 


364 fh 


alpha-0.45 


15 


WST 


625 


sync bits 


24 bits 


336 


NRZ 


0 & 70 IRE 


444 fh 


alpha =0.45 




vrrc 


525 


sync bits 


9 pain of 
biti 

distributed 


72 


NRZ 


0 & 570 
mV 


455/4 
fh 


tr=200 nsec 


20 


vrrc 


625 


sync bits 


9 pain of 
bin 

distributed 


72 


NRZ 


0 & 550 
mV 


116 fh 


tr=200 nsec 




EBU 3217 


625 


sync bits 


8 bits (16 
symbols) 


120 bits 
(240 


Bi-Pbase 


0 & 500 
mV2.5 






25 










symbols) 




Mbps 







30 Various conclusions can be drawn by comparing the different VBI waveform standards set forth in Table 1 . These 
include: 

1 . All of the waveforms can be represented as NRZ data modulated onto the luminance of the video signal, even 
EBU 321 7's bi-phase modulated symbols, but the nominal luminance values representing NRZ "0" and T symbols 

35 differ from waveform to waveform. 

2. The Pulse Shape specifications polarize the waveforms into those which require a pulse shape of less than one 
symbol time in duration for the non-Teletext waveforms and the converse for the Teletext waveforms. 

3. None of the standards specify significant line-to-line or frame-to-frame correlation of data; thus, it is advanta- 
geous to handle each VBI line independently of any other VBI line. 

40 4. VITC's synchronisation bits are best simply handled as data bits. 

5. The number of CCIR-601 samples per symbol ranges by a factor of 13 over all the waveforms. 

6. The symbol-to-risetime ratio ranges from 1 .5 to 8.5 over all the non-Teletext waveforms. 

7. The symbol rate of the waveforms ranges by a factor of 21. 

8. The required start sample of the waveforms, relative to the first CCIR-601 sample, ranges from 27 samples 
45 before CCIR-601 sample zero to 80 samples after sample zero with a nominal value of 26 samples after sample 

zero. 

In view of the above conclusions, it has been determined that a single state machine can be created to reconstruct 
all of these VBI waveforms if the following parameters are programmable in the state machine: 

50 

1 . The field number of the particular VBI line, 

2. The line number of the particular VBI line, 

3. The standard's symbol rate, 

4. The standard's CCIR-601 start sample number, 

55 5. The standard's risetime (symbol transition duration), 

6. The standard's CCIR-601 value for NRZ "0" and "1" symbols, 

7. The number of symbols in the standard's waveform, 

8. The vector of values of the symbols in the particular VBI line's waveform. 
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A state machine providing programmability of the above parameters for use in reconstructing each of the various 
VBI waveforms is disclosed below in connection with Figure 3. Prior to discussing the state machine, the novel syntax 
of the present invention is disclosed in conjunction with an example embodiment of an encoder and decoder structure. 
Figure 1 illustrates, in block diagram form, an encoder for processing raw digital video data into a user data syntax, 

5 referred to herein as "luma NRZ", in which variable amounts of different types of VBI user information can be commu- 
nicated in a digital television data stream. The raw digital video, such as video complying with the Society of Motion Pic- 
ture and Television Engineers (SMPTE) standard is input to a serial receiver 12 via terminal 10. The serial receiver 
serializes the data which is input in a parallel format The serialized data is buffered in a buffer 14, which can comprise 
a conventional first-in first-out (FIFO) register. A video parser 16 interprets the syntax of the serialized data and strips 

w out various information such as that identifying the start of a new line, the start of a new frame, and the raw luminance 
and chrominance data. The luminance and chrominance data is input to a demultiplexer 18 where it is separated into 
data portions corresponding to vertical blanking intervals of successive video frames (e.g., lines 1-21 of a counterpart 
NTSC analog television signal) and the active video portions of those frames. Demultiplexer 18 also determines if syn- 
chronization of the acquired data stream has been lost, and if so, outputs a "sync loss" signal to a video compression 

is processor 22, which also receives the active video to be compressed. The video compression processor is a type well 
known in the art, such as described in U.S. patents 5,376,968; 5,235,41 9; 5,091 ,782; or 5,068,724. 

It is noted that some types of user data which is classified as VBI data may not reside in the actual VBI. For exam- 
ple, programming lineup information used by the A.C. Nielsen Company for market research and referred to as "Auto- 
mated Measurement of Lineup" (AMOL) is inserted into line 22 of field 2 of each television frame in the National 

20 Television Systems Committee (NTSC) broadcasting standard. Line 22 is an active video line, and thus a decoder may 
commence processing active video with line 23 instead of line 22 for NTSC signals. Within a 30-frame sequence, the 
AMOL line for each frame will typically be present, but the data for most frames will generally be null. In order to accom- 
modate AMOL data, the VBI is assumed to extend to line 22 instead of line 21 . 

The data contained in the VBI portions of the digital video input signal is output from demultiplexer 18 to random 

25 access memories (RAMs) 20, which include both a luminance RAM and a chrominance RAM. The RAMs store the data 
until required by a syntax processor 24 which extracts the VBI user information and builds a syntax enabling the infor- 
mation to be transported efficiently in the VBI portions of a digital television data stream to be communicated to a cor- 
responding decoder, e.g., at an end user location. 

The syntax provided by the syntax processor is stored in a header FIFO 28, which is used to assemble transport 

so headers for, e.g., an MPEG or DigiCipher® II implementation of the digital television data stream. The header FIFO pro- 
vides the syntax information to a barrel shifter 30 that combines the header with the compressed active video from a 
video coder 26. The video coder 26 codes the compressed video from the video compression processor 22 in a well 
known manner using, for example, Huffman coding to provide codewords (CW), codeword lengths (CL) and data tags 
which identify the coded information. The output from barrel shifter 30 is a data stream containing the active video sep- 

35 arated by headers which contain information necessary to decode the active video. This data stream is stored in a video 
buffer 32 which provides the data on an as needed basis to a packetizer 34. The packetizer is a conventional compo- 
nent which assembles the data into transport packets in accordance with a transport stream standard such as the 
ATSC, MPEG-2 or DigiCipher® II digital television standard. 

The functions of the syntax processor 24, insofar as they are relevant to the present invention, are described below 

40 using the formal grammar used by the ATSC and MPEG transport standards. This grammar is a C-language-like syntax 
and is a method of describing continuous and possibly variable rate sequences of bits, instead of specifying a proce- 
dural program and its functions as in the computer language C. The first column of the syntax contains the syntax ele- 
ment. The second column gives the length of the syntax elements in bits and the third column identifies the syntax type. 
The types are bslbf (bit string left-most bit first) and uimsbf (unsigned integer most significant bit first). The header 

45 "userjdata 

0 {...}" indicates that the syntax elements within the braces are a named set and may be invoked elsewhere in the syn- 
tax by simply using the designation "user_data ()". A conditional occurrence of bit structures may be indicated with the 
usual "if tests. The customary relational operators well known in the C-language are also available. Loop structures are 
possible and use the standard C loop header syntax. The syntax table is accompanied by a set of semantics, providing 
so definitions for each previously undefined syntax field and placing constraints on their use. The following picture user 
data bitstream syntax (in which the shaded areas represent the standard ATSC user data syntax and the non-shaded 
areas represent the syntax of the present invention) and bitstream semantics illustrate a preferred embodiment of the 
present invention: 

55 
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additionaljfatajype 


8 


uimsof 


additional_data_lamjth 


16 


uimsbf 


if (additional_data_type - - ' 


oxon { 








luma nrz count 


5 


uimsbf 


for (i-0 ; i<luma_nrz_count ; i* +) { 






lum a_nrz_p riority 


2 


uimsbf 


field number 


2 


uimsbf 


line offset 


5 


uimsbf 


$tart_sample 


9 


uimsbf 


nrz increment 


fi 


uimsbf 


nrz modulus 


10 


uimsbf 


0_amplitude 


B 


uimsbf 


1_amp(rtude 


8 


uimsbf 


pulse_shape 


2 


uimsbf 


if (pulse_shape - 


- "rectangular"! { 








symbol to transition ratio 


8 


uimsbf 


} 






if (pulse_shape - 


- 'raised cosine") ( 








reserved 


3 


bslbf 


nrz alpha 


5 


uimsbf 


} 
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if (pulse shape * ■ "rsservcd") { 






reserved 


0 


hcthf 
□ 5101 


r — 

) 






uuatH count 


s 


uimsbf 


for (j-0 ; j<word count ; i + { 






marker_bit 


1 


bstbf 


lumi nrz word 


22 


bstbf 


} 






marker bit 


1 


Wof 


remainder count 


5 


uimsbf 


for (j**0 ; j< remainder count ; { 






luma nrz bit 


1 


bstbf 


} 






mirker bit 
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bslbf 


} 
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30 Picture User Data Semantic Extensions: 

additional_data_type - An 8-bit integer (values in the range [1:255]) indicating the type of additional data con- 
structs following the field. This field shall have the value 01 in hexadecimal to indicate the additional data is luma 
NRZ data. 

35 additional_data_length - A 16-bit unsigned integer (values in the range [0:65535]) indicating the length in bytes 
of additional data constructs following the field. The length does not include the additional_data_length field itself, 
but includes the following additionaljdata for the given additional_data_type, up to but not including subsequent 
additional_data of any other additional_data_type. 

luma_nrz_count - A five-bit integer (values in the range [0:31]) indicating the number of Luma NRZ constructs fol- 
40 lowing the field. All such constructs must occur in the intended line and field display order. 

luma_nrz__priorlty - A number between 0 and 3 indicating the priority of constructs in picture reconstruction where 
different levels of hardware capability exist. For Luma NRZ constructs, a fixed number of lines per display field can 
be labeled as priority zero. 

f ield_number - The number of the field, in display order, from which the VBI data originated, interpreted in Table 2. 

45 



Table 2 



Field Number for Picture User Data. 


Value 


Meaning 


00 


Forbidden 


01 


1st display field 


10 


2nd display field 


11 


3rd display field (the repeated field in film mode). 



llne_offset - A five-bit integer (values in the range [1 :31]) giving the offset in lines from which the Luma NRZ data 
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originated relative to the base VBI frame line (line 9 of 525-line {NTSC and PALVM} field 1 , line 272 of 525-line field 
2, line 5 of 625-line {All PAL except PAL/M] field 1, and line 318 of 625-line field 2), as specified in CCIR Report 
624-4. 

start_sample - A 9-bit unsigned integer (values in the range [0:511]) which indicates the sample of the recon- 
structed luminance line at which the transition into the first luma NRZ symbol shall start. start_sample shall be in 
the same units as CCIR 601 samples and shall be relative to the first sample of CCIR 601 reconstructed frames, 
nrzjncrement - A 6-bit unsigned integer (values in the range [1 :63]) which indicates the Luma NRZ symbol clock 
increment value and takes on values that describe, together with nrz_modulus, the relationship of the Luma NRZ 
symbol clock to a 27 MHz reference. See the semantics of nrzjnodulus for more details. 
nrz_modulus - A 10-bit unsigned integer (values in the range [2:1023]) which indicates the Luma NRZ symbol 
clock modulus value and takes on values that describe, together with nrzjncrement, the relationship of the Luma 
NRZ symbol clock to a 27 MHz reference. Specifically, nrzjncrement and nrz_modulus are related to the Luma 
NRZ symbol rate as: 

nrzjncrement / nrzjnodulus = Luma NRZ symbol rate / system_clock-frequency 
where 

system_clockJrequency is specified in ISO/IEC 13818-1 as 27 MHz ± 30 ppm and the value of nrzjncrement 
must not exceed nrzjnodulus- 1 . 

0_amplitude - An 8-bit unsigned integer (values in the range [1 :254}) which indicates the amplitude at which luma 
NRZ symbols of value 0 shall be reconstructed in units of amplitude of CCIR 601 reconstructed frames. 
1_amplitude - An 8-bit unsigned integer (values in the range [1 :254}) which indicates the amplitude at which luma 
NRZ symbols of value 1 shall be reconstructed in units of amplitude of CCIR 601 reconstructed frames. 
pulse_shape - A 2-bit unsigned integer which indicates the shape of the pulses which shall be used to reconstruct 
this line of Luma NRZ. The meaning of pulse_shape is defined in Table 3. 



Table 3 



Pulse Shape. 


pulse_shape 


Luma NRZ Pulse Shape 


00 


rectangular 


01 


raised cosine 


10 


reserved 


11 


reserved 



symbol_to_transition_ratio - An 8-bit unsigned integer (values in the range [16:255]) which indicates the ratio of 
each luma NRZ symbol's duration to each symbol's transition duration between the amplitudes specified by 
0_amplitude and 1_amplitude and having units of 2' 4 (0.0625). This field describes symbols with a symbol to tran- 
sition ratio ranging from 1.0 to 15.9375. 

nrz_alpha - A 5-bit unsigned integer (values in the range [0:31]) which indicates the value of Alpha for the Raised 
Cosine filter whose pulse shape describes each luma NRZ symbol with units of 2' 5 (0.031 25). This field describes 
values of Alpha from 0.03125 to 1.0. The meaning of nrz_alpha is defined in Table 4. 



Table 4 



NRZ Alpha. 


nrz__alpha 


Alpha value 


00000 


1.0 


00001-11111 


nrz_alpha* 0.03125 



word__count - A 5-bit unsigned integer (values in the range [0:31]) which indicates the number of markerjbit and 
luma_nrz_word pairs that follow this field. 

luma_nrz_word - A 22-bit string of luma NRZ symbols such that the first received bit is the value of the first luma 
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NRZ symbol reconstructed on the video line as displayed from left to right. luma__nrz_words shall be received in the 
order that their symbols are to be reconstructed on the video line as displayed from left to right. 
remainder_count - A 5-bit unsigned integer (values in the range [0:21]) which indicates the number of 
luma_nrz_bits that follow this field. 

Iuma_nrz_bit - A single bit representing the luma NRZ symbol to be reconstructed on the video line. Iuma_nrz_bits 
shall be received in the order that their symbols are to be reconstructed on the video line, subsequent to symbols 
reconstructed from any luma_nrz_words, as displayed from left to right. 

The above syntax is assembled by the syntax processor 24 illustrated in Figure 1 . In the preferred embodiment, the 
syntax processor is implemented in firmware. After the syntax is added to the digital video data, the resultant data 
stream is packetized and output from packetizer 34 to provide the final transport stream for communication to a popu- 
lation of decoders. 

Figure 2 is a block diagram of a video decompression processor (i.e., decoder) for processing a received data 
stream that contains the VBI user data syntax detailed above. The video decompression processor (VDP) incorporates 
a memory manager 130 that addresses a DRAM 122 to store and retrieve video data necessary to reconstruct a tele- 
vision program at a receiver. The processor, generally designated 120, is a pipelined processor designed to decode 
both the transport layer (i.e., control and other non-video information) and the video layer of the compressed bitstream 
input via terminal 1 10, sometimes referred to as the "transport packet interface" of the video processor. 

A user processor interface which can comprise, for example, an M-bus controller 150 is provided at terminal 114 
for control of the video data processor. This interface configures various registers in processor 120 as well known in the 
art. 

An interface to the DRAM 122 is provided via address lines 124 and data lines 126. In the example illustrated in 
Figure 2, DRAM 122 has a nine bit address port and a thirty-two bit data port. 

A video output interface 1 38 is provided for the decompressed, reconstructed video which may for example, be out- 
put as a standard CCIR 656, eight bit, twenty-seven MHz multiplexed luminance (Y) and chrominance (Cr, Cb) signal. 

A test interface can be provided via terminal 162 to a conventional JTAG (Joint Test Action Group) controller 160. 
JTAG is a standardized boundary scan methodology used for board-level testing to detect faults in package and board 
connections, as well as internal circuitry. 

The video decompression processor 120 receives a clock signal via terminal 112. The clock provides timing infor- 
mation that is used, e.g., to enable a transport syntax parser 132 to recover timing information and video information 
from transport packets contained in a packetized data stream input via terminal 1 10. An acquisition and error manage- 
ment circuit 134 utilizes a program clock reference (PCR) and decode time stamp (DTS) detected by a video syntax 
parser 140 to synchronize the start of picture decoding. This circuit sets vertical synchronization and provides global 
synchronization for all video decode and display functions. 

The video layer is buffered in an input buffer (FIFO) configured in the DRAM 122 by memory manager 130. The 
video syntax parser 140 receives the compressed video data output from the DRAM FIFO via memory manager 130, 
and separates the motion vector information from the coefficients describing the video information. The coefficients are 
processed by a Huffman decoder 152, inverse quantizer 154, and inverse discrete cosine transform (IDCT) processor 
156. 

Motion vectors are recovered and used to address previously decoded video frames required for reconstructing a 
current video frame. In particular, a motion vector decoder 142 decodes the motion vectors received from video syntax 
parser 1 40 and passes them to a prediction address generator 1 44. The prediction address generator provides address 
information necessary to retrieve, via memory manager 130, the necessary anchor frame (i.e., intraframe (I) or predic- 
tion (P) frame) data to enable prediction calculator 1 46 to provide a prediction signal necessary to reconstruct a current 
frame block. Differential decoder 148 combines the prediction data with the decoded coefficient data to provide decom- 
pressed video data. The decompressed data is stored in appropriate buffers of DRAM 122 via memory manager 130. 
It should be appreciated that the video decompression processes carried out by motion vector decoder 142, prediction 
address generator 1 44, prediction calculator 1 46, differential decoder 1 48, Huffman decoder 1 52, inverse quantizer 154 
and IDCT 156 are generally conventional and well understood by those skilled in the art. 

Memory manager 130 schedules all activity on the DRAM address and data buses 124, 126 and efficiently 
addresses DRAM 122. The memory manager insures that the data transfer requirements of the input FIFO portion of 
DRAM 122, the video syntax parser 140 and the video reconstruction circuit 136 (as well as prediction calculator 146 
and differential decoder 148) are all met. The video reconstruction circuit 136 calculates a current picture and proc- 
esses the VBI user data in order to insert any user data present, for output on video output line 138. The video output 
138 will contain all of the transmitted VBI user information together with the decompressed active video, in the original 
format presented to the serial receiver 12 illustrated in Figure 1. 

DRAM 122 is illustrated as an external memory. It should be appreciated that in future implementations, and as 
memory technology advances, DRAM 122 may be provided as internal memory within the video decompression proc- 
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essor. The DRAM is mapped to provide various decode and output video buffers as well as a circular FIFO buffer for 
the compressed input video bitstream. The DRAM may also be used to provide a test pattern buffer, a VITS buffer and 
a closed captioning display reordering buffer as well as to store various picture structure data necessary to properly dis- 
play the decoded video frames. The DRAM can be reinitialized via memory manager 130 to provide different memory 
maps as required when variables are modified such as PAL or NTSC video, eight or sixteen Mbit memory configuration, 
and whether B-frames are present. 

As indicated above, the memory manager 130 schedules all of the activity on the DRAM buses including the data 
transfer requirements of the input FIFO, the video parser and the video reconstruction circuit. The memory manager 
also performs the required DRAM refresh in a conventional manner. For example, the same row in each of two or four 
DRAMs can be refreshed simultaneously. 

When a packetized bitstream containing compressed video data is input to terminal 110 of video decompression 
processor 120, video frames represented by the compressed data are reconstructed one at a time. Initially, a full frame 
of video data will have to be received and stored in DRAM 122. Information for subsequent video frames can comprise 
a subset of the full video frame which, when added to prediction data from the prior video frame (stored in DRAM 122) 
will result in the reconstruction of a full frame. 

Figure 3 is a block diagram of a pixel generator for generating a digital VBI waveform from user data carried in a 
digital video data stream according to the syntax set forth above. The waveform generator is part of the video recon- 
struction circuit 136 of Figure 2, and is capable of accommodating the various parameters for the AMOL, VITC and EBU 
VBI standards set forth in Table 1 . Each of these VBI services has a corresponding number of pixels per symbol. The 
closed caption, AMOL, VITC and EBU services have pulses with an impulse response time which is less than one sym- 
bol time, referred to herein as single symbol impulse response. The teletext services have a multisymbol impulse 
response, wherein the impulse response time is several symbols. A waveform generator for services having a multisym- 
bol impulse response is described in Figure 4. 

The services with a single symbol impulse response each have a corresponding rise time, total transition time, and 
number of pixels per transition This information is summarized for each service type in Table 5. 



Tables 



VBI Service Characteristics 


Standard 


Pixels/Symbol 
(Fraction) 


Pixels/Symbol 


10%-90% Rise- 
time 


Total Transition 


Pixels/Transition 


Closed Captions 


429/16 


26.81 


240 nsec 


406.78 nsec 


5.4915 


AMOL I 


27/2 


13.5 


250 nsec 


423.73 nsec 


5.7204 


AMOL II 


27/4 


6.75 


125 nsec 


211.86 


2.8601 


NABTS 


33/14 


2.36 


N/A 


N/A 


N/A 


WST(525) 


33/14 


2.36 


N/A 


N/A 


N/A 


WST (625) 


72/37 


1.95 


N/A 


N/A 


N/A 


VITC (525) 


264/35 


7.54 


200 nsec 


338.98 nsec 


4.5762 


VITC (625) . 


216/29 


7.45 


200 nsec 


338.98 nsec 


4.5762 


EBU 3217 


27/5 


5.4 


250 nsec 


423.73 


5.7204 



The single symbol impulse response category of service has the characteristic that there are four or more pixels at 
CCIR 601 sampling rate per symbol. As can be seen from Table 5, closed caption has the maximum number of pixels 
per symbol, namely 27. For single symbol impulse response services, there is no overlap from one symbol to the next. 
The time response of the symbol is characterized by its transition and the full amplitude portion. 

The transition portion of a symbol can be downloaded as part of the service, or resident in a transition memory 
(ROM or RAM), such as provided in transition generator 218 in Figure 3. The use of ROM is more efficient in terms of 
hardware complexity and channel efficiency. A sine squared transition will work for all of the various VBI services. 

Data to be inserted into a VBI waveform at a decoder is inserted via a symbol input 200 and queued up in a FIFO 
202. The data is inserted into the VBI by playing back the symbols through a pixel generator. The pixel generator will 
be provided with the high and low levels to insert (0_amplitude and 1_amplitude) via terminal 201, the frame line 
number on which to insert the data (derived from field_number and line_offset) via terminal 203, the transition type 
(derived from pulse_shape) via terminal 205, the number of symbols to insert (derived from word__count and 
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remainder_count) via terminal 207, the nrz_modulus and nrzjncrement via terminals 209 and 211 respectively, the 
symbol_to_transition_ratio via terminal 21 3, and the start time of the first symbol (start_sample) via terminal 215. All of 
this information is specific to the particular type of VBI data to be inserted, and is provided via the syntax defined above. 
The video data into which the VBI data is to be inserted is input to the waveform generator via terminal 217. 

The video data is provided, for example, in a conventional CCIR 656 format and is coupled to a multiplexer 254. 
The multiplexer also receives a gating signal from an insertion window generator 248. which enables the multiplexer to 
output VBI data during a time window that is, for example, 704 pixels in length. 

In order to insert the VBI data into the video at the proper location, a line count of the video data is maintained and 
compared to the desired line of insertion. This function is provided by a line detector 244 and line time generator 246 
which receives the current line information from the video data via terminal 21 7. The line time generator 246 is enabled 
by line detector 244 when the line into which VBI data is to be inserted is detected by the line detector. The line time 
generator then keeps track of the pixels for that video line, and provides the video line pixel count to insertion window 
generator 248 in order to provide the proper insertion window of, e.g., 704 active pixels. 

Upon the arrival of a zero datum of the correct line, the line time generator 246 also signals a start time detector 
(counter) 21 4 which commences a down count for the start pixel time dictated by the start_sample information obtained 
from the syntax. The start pixel down counter 214 enables a symbol dock generator 210 which, in turn, clears a symbol 
counter 212. 

The symbol clock generator 210 receives the nrz_modulus and nrzjncrement from the syntax. Once the symbol 
clock generator is started in response to detector 214, the symbol time is derived by incrementing a counter by the 
numerator of the fraction symbol time over pixel time. The modulus of the counter is the denominator of the fraction. If 
desired, the numerator and denominator may be multiplied by a constant to simplify the hardware implementation. 

The symbol clock generator 210 outputs a symbol clock to the FIFO enable for clocking the VBI data out from the 
FIFO 202. It also provides the fraction of symbol time that a current sample represents to a transition time scaling circuit 
216, described below. The symbol clock runs until the symbol counter 212 counts the number of symbols specified by 
the word_count and remainder_count from the syntax, at which time a stop signal is generated. The stop signal also 
clears the shift register 206 in the VBI data path. 

The VBI data shifted through register 206 is monitored by a transition sign detection circuit 208. The presence or 
absence of a transition is detected by comparing the previous transmitted symbol with the current symbol to be trans- 
mitted. If they are the same, the same value is generated and transmitted. If there is a difference between the two sym- 
bols, then transition generator 218, which may comprise, for example, read only memory (ROM) or random access 
memory (RAM) is selected. 

The transition generator stores data for generating multiple ramps, one for each transition type that is supported. 
The ramps represent the transitions for the VBI data pulses for the different VBI standards. The particular ramp selected 
for the current VBI data is determined by the transition type specified by the pulse^value of the syntax and input to the 
transition generator 218 via terminal 205. The beginning and end of the transition are dictated by the addresses input 
to the transition generator from the transition time scaling circuit 216, which scales the fraction of symbol time in accord- 
ance with the symbol to transition duration ratio from terminal 213 and the nrzjnodulus from terminal 209. The scaled 
fraction of the symbol time represents the position of the sample in time within the rise time of the VBI data pulse. The 
transition process is repeated until detection circuit 220 determines that the address exceeds the range of the transition 
generator ROM or RAM, at which time the symbol has reached 100 percent of its final value. An output multiplexer 
(selector) 242 then selects the final value for the current and remainder of that symbol's pixels. Selection logic 222 con- 
trols the multiplexer 242 based on the initial detection of a transition by transition detection circuit 224 and the comple- 
tion of the transition as determined by circuit 220. 

A look up table (LUT) 236 (stored, e.g., in ROM) converts each bit of data output from shift register 206 into an 
eight-bit level that is ultimately scaled to the proper luminance level for the particular type of user data being processed. 
For example, LUT 236 can convert a binary "O" into the eight-bit word 00001 1 1 1 and a binary "1 " into the eight-bit word 
1 1 1 0000. This mapping is arbitrary, and any other desired eight-bit levels can be chosen for the binary "1 " and "0". The 
eight-bit level from the output of LUT 236 is provided to multiplexer 242 which selects this level for output unless a tran- 
sition is in progress as indicated by select logic 222, in which case the transition from transition generator 218 is output. 

The data stream output from multiplexer 242 is then scaled to the required output levels in response to the 
0_ampIitude and 1_amplitude values delivered by the user data syntax via terminal 201. An output multiplexer 254 
inserts the resultant VBI data on the video stream from terminal 217, for the insertion window provided by generator 
248. The insertion window corresponds to the active video duration. 

Multiple VBI services can be inserted with the generator of Figure 3. Additional circuitry is necessary to load the 
variables required to run the generator on a line-by-line basis. The data is cued up in a common FIFO. In the implemen- 
tation shown, all clocks are running at 13.5 MHz, unless otherwise indicated. This is one-half the rate of the standard 
MPEG, ATSC and DigiCipher system clock. 

Data complying with EBU 3217 has the property that the transition time is slightly longer than the symbol time. This 
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can be overcome by selecting a translation that has a slower ten percent to ninety percent time relative to the entire 
transition. The specified filter for wave shaping EBU 3217 data is Gaussian transitional. A windowed Gaussian transi- 
tion may provide better performance than sine squared. 

Teletext services can be supported in a similar manner as disclosed for the VBI services discussed in connection 
with Figure 3. To support teletext, the waveform generator must handle an impulse response which, as noted above, is 
greater than one symbol. An example implementation of such a VBI waveform generator is illustrated in Figure 4. 

The VBI Data FIFO 310, shift register 312, symbol counter 316, symbol clock generator 320, start time detect cir- 
cuit 322, scale and offset circuit 306, multiplexer (selector) 308, insertion window generator 332, line detect circuit 330 
and line time generator 328 of Figure 4 are equivalent to the similarly named elements in Figure 3. In order to handle 
multisymbol impulse responses of the teletext services, which can range from 1 .89 to 2.36 samples per symbol at 13.5 
MHz sampling, a transmit (Tx) filter ROM 302 and interpolation filter 314 are provided. It should be appreciated that the 
filter 302 can also be implemented in RAM if desired, particularly if the impulse response of the desired format is to be 
downloaded instead of being stored locally in ROM. Any such download will be at a fixed number of samples per symbol 
rate. The interpolator is used to generate the 13.5 MHz rate pixels. The rate difference is the increment of the interpo- 
lator. 

The data to be inserted is queued up in FIFO 31 0 via terminal 303. The data is inserted into the VBI by playing back 
the symbols through the pixel generator. The pixel generator is provided with the start time of the first symbol pixel via 
terminal 315, the number of pixels per symbol (increment/modulus) via terminals 31 1 and 309, the high and low levels 
(0_amplitude and 1_amplitude) to insert via terminal 300, the impulse response of the signaling system (transition type) 
via terminal 301, the number of symbols to insert via terminal 307, and the frame and line number on which to insert 
the data via terminal 305. 

The video data input to terminal 31 7 is provided in CCIR 656 format. The line count is derived and compared to the 
desired line of insertion in circuits 330, 328 and 322. Upon the arrival of the correct line's zero datum, a down count for 
the start pixel time is started in circuit 322, which enables the symbol rate clock generator 320 at the appropriate time. 
The 704 pixel window generator 332 is enabled by the line time generator 328. 

As in the waveform generator of Figure 3, symbol time is derived by incrementing a counter by the numerator of the 
fraction "symbol time/pixel time", where the increment "INCR" is the numerator and the modulus of the counter is the 
denominator of the fraction. In addition to receiving the modulus and increment via terminals 309 and 31 1 , respectively, 
the symbol clock generator 320 receives the system clock (e.g., 27 MHz) via terminal 313. By running the symbol clock 
generator at, e.g., 27 MHz rather than 1 3.5 MHz, a twice symbol rate clock is generated. 

The enable input of FIFO 31 0 receives the symbol clock from a divider 31 8, which divides the output of clock gen- 
erator 320 by two. This is necessary because the symbol clock generator provides a clock at twice the symbol rate. 
Once the specified number of symbols has been output from the FIFO, the symbol clock is disabled for the current tel- 
evision line. All subsequent data symbols are forced to the low (zero) state. These symbols are not data, but rather fill 
the balance of the 704 pixel window with low state data. 

The transmit filter ROM 302 generates two samples per symbol. The transmit shift register is loaded with transmit 
symbols at the symbol rate, when start time has arrived. The register is initialized to a low state on completion of each 
insertion. The transmit data for the duration of the impulse response is applied to the transmit ROM from shift register 
312. The ROM stores a look up table of finite impulse responses (FIR), computed in advance in accordance with well 
known techniques. By storing the results of the FIR calculation in the ROM, it is not necessary to store the FIR coeffi- 
cients to calculate the results. The appropriate FIR for the particular transition to be provided in the VBI waveform is 
output from the LUT when the ROM is addressed by the transition type via terminal 301 . 

The output of the transmit filter is provided to an interpolating filter 314 via register 304. The interpolation filter con- 
verts the 2 sample per symbol rate data to 13.5 MHz samples. An example of an appropriate interpolation filter is 
described by the following FIR coefficients: 

A 2 
Aqs an - a\i 

A .|= -a|i +(a+1)n 

2 

A 2 = -a[i +(a-1)ji + 1 

a 2 
A 3 = a|i - a\i 

a is defined to be 0.5. n is the time for the sample to be interpolated. The frequency response 400 of this interpolator 
(Paralntr) and the transmit impulse responses 402, 404, 406 and 408 for the various teletext standards, as well as for 
the VideoCipher standard proprietary to the original assignee of the present invention, are illustrated in Figure 5. It can 
be seen that the interpolator clearly influences the transmitted frequency response. This frequency response error can 
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be corrected (predistorted) in the transmit filter 302 to minimize its impact. It is a requirement that the transmit spectrum, 
and its images be well controlled prior to interpolation. This is the case for the described data signal types. If the pixel 
rate per symbol is less than about 3 samples per symbol, a greater number of samples per symbol would be required. 
The data supplied to the interpolator 314 is at twice symbol rate. The actual transfers of data occur coincident with 

5 the 27 MHz tick. The interpolator output is read at 13.5 MHz. 

The time interpolation variable is supplied to the filter at the 1 3.5 MHz rate. A time generator 324 and scaling circuit 326 
allow the numerical representation of u to be consistent with the numerical system of the filter hardware, and independ- 
ent of the current modulus value. 

The data stream has to be scaled to the required output levels. This can be accomplished, for example, with one 

w multiply and addition per pixel provided by the scale and offset circuit 306. The output multiplexer 308 inserts the V8I 
data from the scale and offset circuit 306 on the CCIR video stream from terminal 317, for the 704 pixel window. 

There are various alternate ways to implement the functions provided by the waveform generator circuits of Figures 
3 and 4, and the specific embodiments illustrated are by no means meant to be limiting. For example, the scaling and 
offset can be done earlier in the process than illustrated. In the embodiment of Figure 4, any of a variety of known inter- 

is polators can be used. Moreover, in the multisymbol embodiment, lower data rates can be supported by having impulse 
responses with more samples per symbol. All of the current teletext standards are supported by two samples per sym- 
bol. 

Additionally, M-level multilevel pulse amplitude modulation (PAM) can be supported using the waveform generator 
of Figure 4. In such implementations, there would be log base 2 of M bits per symbol, rather than one supplied to the 
20 transmit filter ROM. 

It should now be appreciated that the present invention provides a method and apparatus for communicating user 
information in a digital television data stream. The user information is a type that is conventionally carried as NRZ data 
in the vertical blanking interval of an analog television signal. The user data is transported in a user data syntax, which 
has been supplemented with various fields. These include an additional data type field, a luma NRZ count and priority, 
25 field number, line offset, start sample, NRZ increment and modulus, amplitude values, pulse shape information, and 
word and remainder count information relating to the user data which is carried in the form of luma words and luma NRZ 
bits. 

Although the invention has been described in connection with a preferred embodiment, it should be appreciated 
that various adaptations and modifications may be made thereto without departing from the spirit and scope of the 
30 invention as set forth in the claims. 

Claims 

1 . A method for communicating, in a digital television data stream, information of a type conventionally carried as NRZ 
35 data in a vertical blanking interval (VBI) waveform of an analog television signal, said digital television data stream 

transporting data according to a convention that includes a user data syntax, said method comprising the steps of: 

supplementing said user data syntax with a line indicator value specifying horizontal television line(s) relative 
to a base VBI frame line in which user information is carried as NRZ data in a counterpart television signal; 
40 supplementing said user data syntax with at least one timing reference value that defines a relationship 

between a symbol rate of said NRZ data and a reference clock of said digital television data stream; 
supplementing said user data syntax with at least one count value indicating an amount of user information 
carried in the digital television data stream; and 

supplementing said user data syntax with at least one user information field sufficient to carry the amount of 
45 user information indicated by said at least one count value. 

2. A method in accordance with claim 1 comprising the further step of: 

supplementing said user data syntax with a start sample value indicative of a sample point at which a transition 
so into a first luma NRZ symbol is to commence in a counterpart television signal reconstructed from said digital 

television data stream. 

3. A method in accordance with claim 1 or 2 comprising the further step of: 

55 supplementing said user data syntax with a first amplitude value indicative of an amplitude at which luma NRZ 

symbols are to appear in said counterpart television signal reconstructed from said digital television data 
stream. 
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4. A method in accordance with one of the preceding claims comprising the further step of: 

supplementing said user data syntax with a pulse shape value indicative of a pulse shape that is to be provided 
for said luma NRZ symbols in said counterpart television signal reconstructed from said digital television data 
stream. 

5. A method in accordance with one of the preceding claims comprising the further step of: 

supplementing said user data syntax with a field number indicative of a television field in which corresponding 
VBI data is to be inserted in said counterpart television signal reconstructed from said digital television data 
stream. 

6. A method in accordance with one of the preceding claims wherein said user data syntax is capable of delivering a 
plurality of luma NRZ constructs, each carrying associated user information, comprising the further step of: 

supplementing said user data syntax with a luma NRZ count value indicative of the number of said luma NRZ 
constructs following the luma NRZ count value. 

7. A method in accordance with one of the preceding claims comprising the further step of: 

supplementing said user data syntax with a data type field specifying that luma NRZ data follows. 

8. A method in accordance with one of claims 3 to 7 comprising the further step of: 

supplementing said user data syntax with a second amplitude value indicative of a second amplitude level of 
said luma NRZ symbols. 

9. A method in accordance with one of claims 6 to 8 comprising the further step of: 

supplementing said user data syntax with a priority value designating a priority of said luma NRZ constructs for 
use in reconstructing said counterpart television signal from said digital television data stream. 

10. A method in accordance with one of the preceding claims wherein said timing reference value comprises a luma 
NRZ symbol clock increment value and a luma NRZ modulus value, said symbol clock increment and modulus val- 
ues being related to said NRZ symbol rate and said reference clock as follows: 

increment value _ symbol rate 
modulus value " reference clock 



11 . A method in accordance with one of the preceding claims wherein said count value comprises a word count indi- 
cating an integer number of luma NRZ words that follow and a remainder count indicating a number of luma NRZ 
bits totaling less than a full luma NRZ word that follow; 

said syntax thereby providing an efficient use of bandwidth by enabling remainders of less than a full NRZ word 
to be communicated. 

12. A method in accordance with claim 1 1 wherein said luma NRZ words are each 22 bits in length, said method com- 
prising the further step of: 

inserting a marker bit after each luma NRZ word to guard against a false MPEG start code. 

1 3. A method in accordance with one of the preceding claims wherein: 

said user information is carried according to said user data syntax as luma NRZ words and luma NRZ bits; 
each luma NRZ word comprises a string of luma NRZ symbols with the first bit corresponding to a first luma 
NRZ symbol to be reconstructed on a video line as displayed from left to right; and 
each luma NRZ bit represents a luma NRZ symbol to be reconstructed on said video line; 
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said luma NRZ bits being provided in the order in which their symbols are to be reconstructed on said video 
line subsequent to symbols reconstructed from any luma NRZ words, as displayed from left to right. 

14. A method in accordance with one of the preceding claims wherein: 

said NRZ data is carried in a luminance (luma) portion of said V8I waveform. 

15. Receiver apparatus for decoding, from a digital television data stream, user information of a type conventionally 
carried as NRZ data in a vertical blanking interval (VBI) waveform of an analog television signal, said digital televi- 
sion data stream transporting data according to a convention that includes a user data syntax, comprising: 

a syntax processor for detecting information carried in accordance with said user data syntax, said information 
including: 

a first value identifying horizontal television line(s) relative to a base VBI frame line in which particular user 
information is carried in a counterpart television signal, 

a second value identifying a relationship between an NRZ symbol rate of said counterpart television signal 
and a digital television data reference clock, 

a third value indicating an amount of user information carried in the digital television data stream, and 
said user information; 

a reconstruction processor responsive to said first, second and third values for formatting said user information 
into VBI NRZ data; and 

a VBI inserter for inserting said VBI NRZ data into a television signal reconstructed from said digital television 
data stream. 

16. Apparatus in accordance with claim 15 wherein: 

said syntax processor detects a start sample value indicative of a sample point at which a transition into a first 
NRZ symbol is to commence in said reconstructed television signal; and 

said VBI inserter is responsive to said start sample value for inserting said NRZ data into said reconstructed 
television signal. 

17. Apparatus in accordance with one of claims 15 to 16 wherein: 

said syntax processor detects a first amplitude value indicative of an amplitude at which NRZ symbols are to 
appear in said reconstructed television signal; and 

said reconstruction processor is responsive to said first amplitude value to provide said VBI NRZ data at said 
amplitude. 

18. Apparatus in accordance with one of claims 15 to 1 7 wherein: 

said syntax processor detects a pulse shape value indicative of a pulse shape that is to be provided for said 
NRZ symbols in said reconstructed television signal; and 

said reconstruction processor is responsive to said pulse shape value to provide said VBI NRZ data with said 
pulse shape. 

19. Apparatus in accordance with one of claims 15 to 18 wherein: 

said syntax processor detects a field number indicative of a television field in which corresponding VBI data is 
to be inserted in said reconstructed television signal; and 

said VBI inserter is responsive to said field number for inserting said corresponding VBI data into a proper field. 

20. Apparatus in accordance with one of claims 15 to 19 wherein: 

said syntax processor detects and is responsive to an NRZ count value indicative of a number of NRZ con- 
structs to be processed. 
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21. Apparatus in accordance with one of claims 15 to 20 wherein: 

said syntax processor detects and is responsive to a data type field for locating NRZ data in said digital televi- 
sion data stream. 

22. Apparatus in accordance with one of claims 17 to 21 wherein: 

said syntax processor detects a second amplitude value indicative of a second amplitude at which NRZ sym- 
bols are to appear in said reconstructed television signal; and 

said reconstruction processor is responsive to said first and second amplitude values to provide said VBI NRZ 
data at said first and second amplitudes. 

23. Apparatus in accordance with one of claims 15 to 22 wherein: 

said syntax processor detects a priority value designating a priority of said NRZ constructs; and 

said reconstruction processor is responsive to said priority value for use in formatting said user information. 
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